D10_Hadoop - Set! Inventory.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d04ba-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d062c-495a-11e8-9d32-0242ac130002",
     "previous": null
    }
   },
   "source": [
    "# About: Hadoop - Set! Inventory\n",
    "\n",
    "----\n",
    "\n",
    "このお手本では、ホスト表に記述されたマシンにNotebook(Ansible)からアクセスするため、\n",
    "Ansible用のInventoryファイルを更新する手順を説明しています。\n",
    "\n",
    "Hadoopクラスタを構成するホストのマスタは表形式で管理しています(例:  [hosts.csv](../edit/hosts.csv))\n",
    "\n",
    "このホスト表には、複数のクラスタに関して以下の情報が記述されます。\n",
    "\n",
    "- ホストが所属するクラスタ名\n",
    "- ホストの名前, マシンタイプ\n",
    "- ホストのIPアドレス\n",
    "- ホストのスペック\n",
    "- ホストに配置するサービス"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d062c-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d0776-495a-11e8-9d32-0242ac130002",
     "previous": "a10d04ba-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "## *Operation Note*\n",
    "\n",
    "*This is a cell for your own recording.  ここに経緯を記述*"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d0776-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d08ac-495a-11e8-9d32-0242ac130002",
     "previous": "a10d062c-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "# 構築対象の指定\n",
    "\n",
    "Hadoopクラスタを構成するホスト表ファイル名を指定します。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": true,
    "lc_cell_meme": {
     "current": "a10d08ac-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d09d8-495a-11e8-9d32-0242ac130002",
     "previous": "a10d0776-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [],
   "source": [
    "# ホスト表ファイルのパス\n",
    "hosts_csv = 'hosts.csv'"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d09d8-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d0b04-495a-11e8-9d32-0242ac130002",
     "previous": "a10d08ac-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "## クラスタ情報の更新\n",
    "\n",
    "クラスタ情報を更新する。ここではテストクラスタに関する情報を追加することにします。(クラスタ名は `TestCluster` とします)\n",
    "\n",
    "まず、現在のホスト表ファイルをバックアップしておく。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d0b04-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d0c26-495a-11e8-9d32-0242ac130002",
     "previous": "a10d09d8-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'/tmp/tmpC7TYKk'"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import tempfile\n",
    "work_dir = tempfile.mkdtemp()\n",
    "work_dir"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true,
    "lc_cell_meme": {
     "current": "a10d0c26-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d0d52-495a-11e8-9d32-0242ac130002",
     "previous": "a10d0b04-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [],
   "source": [
    "!cp hosts.csv {work_dir}/hosts-old.csv"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d0d52-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d105e-495a-11e8-9d32-0242ac130002",
     "previous": "a10d0c26-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "[hosts.csv](../edit/hosts.csv) にVMの情報を追加し、各VMにロールを割り当てる。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d105e-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d125c-495a-11e8-9d32-0242ac130002",
     "previous": "a10d0d52-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "--- /tmp/tmpC7TYKk/hosts-old.csv\t2016-08-26 11:27:12.642144914 +0900\r\n",
      "+++ hosts.csv\t2016-08-26 11:27:38.622366625 +0900\r\n",
      "@@ -19,3 +19,10 @@\r\n",
      " Cluster2,sn0202,sn02020801,XXX.XXX.XXX.10,XXX.XXX.XXX.229,16,65536,10,15,64512,,x,x,,x,,x,,x,,x,,,,,,,,,\r\n",
      " Cluster2,sn0202,sn02021601,XXX.XXX.XXX.6,XXX.XXX.XXX.227,16,65536,10,15,64512,,,,,x,,x,,,,x,,,,,,,,,\r\n",
      " Cluster2,sn0203,sn02030801,XXX.XXX.XXX.22,XXX.XXX.XXX.235,16,65536,10,15,64512,,,,,x,,x,,,,x,,,,,,,,,\r\n",
      "+TestCluster,vm,testvm001,,XXX.XXX.XXX.70,2,10240,-,-,-,x,x,x,x,,x,,,,x,,,,,,,,,,\r\n",
      "+TestCluster,vm,testvm002,,XXX.XXX.XXX.71,2,10240,-,-,-,,x,x,x,,x,,,,x,,,,,,,,,,\r\n",
      "+TestCluster,vm,testvm003,,XXX.XXX.XXX.72,2,10240,-,-,-,,x,x,,,,,x,x,,,x,x,x,x,x,x,,,\r\n",
      "+TestCluster,vm,testvm004,,XXX.XXX.XXX.73,2,10240,1,1,4096,,,,,x,,x,,,,x,,,,,,,,,\r\n",
      "+TestCluster,vm,testvm005,,XXX.XXX.XXX.112,2,10240,1,1,4096,,,,,x,,x,,,,x,,,,,,,,,\r\n",
      "+TestCluster,vm,testvm006,,XXX.XXX.XXX.113,2,10240,1,1,4096,,,,,x,,x,,,,x,,,,,,,,,\r\n",
      "+TestCluster,vm,testvm007,,XXX.XXX.XXX.114,2,10240,1,1,4096,,,,,x,,x,,,,x,,,,,,,,,\r\n"
     ]
    }
   ],
   "source": [
    "!diff -ur {work_dir}/hosts-old.csv hosts.csv"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d125c-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d1392-495a-11e8-9d32-0242ac130002",
     "previous": "a10d105e-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "## クラスタの情報の確認\n",
    "\n",
    "最新のホスト一覧を表で確認します。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d1392-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d14fa-495a-11e8-9d32-0242ac130002",
     "previous": "a10d125c-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Cluster</th>\n",
       "      <th>Type</th>\n",
       "      <th>Name</th>\n",
       "      <th>Internal IP</th>\n",
       "      <th>Service IP</th>\n",
       "      <th>VCPUs</th>\n",
       "      <th>Memory(MiB)</th>\n",
       "      <th>DFS Volumes</th>\n",
       "      <th>YARN VCPUs</th>\n",
       "      <th>YARN Total Memory(MB)</th>\n",
       "      <th>...</th>\n",
       "      <th>HBase RegionServer</th>\n",
       "      <th>Tez</th>\n",
       "      <th>Hive</th>\n",
       "      <th>Pig</th>\n",
       "      <th>Client</th>\n",
       "      <th>Spark</th>\n",
       "      <th>Spark HistoryServer</th>\n",
       "      <th>KDC Master</th>\n",
       "      <th>KDC Slave</th>\n",
       "      <th>Docker</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>cn0107</td>\n",
       "      <td>cn01070401</td>\n",
       "      <td>XXX.XXX.XXX.85</td>\n",
       "      <td>XXX.XXX.XXX.197</td>\n",
       "      <td>12</td>\n",
       "      <td>98304</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>cn0107</td>\n",
       "      <td>cn01070402</td>\n",
       "      <td>XXX.XXX.XXX.86</td>\n",
       "      <td>XXX.XXX.XXX.198</td>\n",
       "      <td>12</td>\n",
       "      <td>98304</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>cn0107</td>\n",
       "      <td>cn01070403</td>\n",
       "      <td>XXX.XXX.XXX.87</td>\n",
       "      <td>XXX.XXX.XXX.199</td>\n",
       "      <td>12</td>\n",
       "      <td>98304</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>cn0107</td>\n",
       "      <td>cn01070404</td>\n",
       "      <td>XXX.XXX.XXX.88</td>\n",
       "      <td>XXX.XXX.XXX.200</td>\n",
       "      <td>12</td>\n",
       "      <td>98304</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>cn0107</td>\n",
       "      <td>cn01070603</td>\n",
       "      <td>XXX.XXX.XXX.83</td>\n",
       "      <td>XXX.XXX.XXX.195</td>\n",
       "      <td>12</td>\n",
       "      <td>98304</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>cn0107</td>\n",
       "      <td>cn01070604</td>\n",
       "      <td>XXX.XXX.XXX.84</td>\n",
       "      <td>XXX.XXX.XXX.196</td>\n",
       "      <td>12</td>\n",
       "      <td>98304</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>sn0202</td>\n",
       "      <td>sn02020401</td>\n",
       "      <td>XXX.XXX.XXX.12</td>\n",
       "      <td>XXX.XXX.XXX.230</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>sn0202</td>\n",
       "      <td>sn02021201</td>\n",
       "      <td>XXX.XXX.XXX.8</td>\n",
       "      <td>XXX.XXX.XXX.228</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>sn0202</td>\n",
       "      <td>sn02022001</td>\n",
       "      <td>XXX.XXX.XXX.4</td>\n",
       "      <td>XXX.XXX.XXX.226</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>sn0202</td>\n",
       "      <td>sn02022401</td>\n",
       "      <td>XXX.XXX.XXX.2</td>\n",
       "      <td>XXX.XXX.XXX.225</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>sn0203</td>\n",
       "      <td>sn02030401</td>\n",
       "      <td>XXX.XXX.XXX.24</td>\n",
       "      <td>XXX.XXX.XXX.236</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>sn0203</td>\n",
       "      <td>sn02031201</td>\n",
       "      <td>XXX.XXX.XXX.20</td>\n",
       "      <td>XXX.XXX.XXX.234</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>sn0203</td>\n",
       "      <td>sn02032001</td>\n",
       "      <td>XXX.XXX.XXX.16</td>\n",
       "      <td>XXX.XXX.XXX.232</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>sn0203</td>\n",
       "      <td>sn02032401</td>\n",
       "      <td>XXX.XXX.XXX.14</td>\n",
       "      <td>XXX.XXX.XXX.231</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Cluster1</td>\n",
       "      <td>sn0203</td>\n",
       "      <td>sn02031601</td>\n",
       "      <td>XXX.XXX.XXX.18</td>\n",
       "      <td>XXX.XXX.XXX.233</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Cluster2</td>\n",
       "      <td>cn0107</td>\n",
       "      <td>cn01070601</td>\n",
       "      <td>XXX.XXX.XXX.81</td>\n",
       "      <td>XXX.XXX.XXX.193</td>\n",
       "      <td>12</td>\n",
       "      <td>98304</td>\n",
       "      <td>10.0</td>\n",
       "      <td>11.0</td>\n",
       "      <td>97280.0</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Cluster2</td>\n",
       "      <td>cn0107</td>\n",
       "      <td>cn01070602</td>\n",
       "      <td>XXX.XXX.XXX.82</td>\n",
       "      <td>XXX.XXX.XXX.194</td>\n",
       "      <td>12</td>\n",
       "      <td>98304</td>\n",
       "      <td>10.0</td>\n",
       "      <td>11.0</td>\n",
       "      <td>97280.0</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Cluster2</td>\n",
       "      <td>sn0202</td>\n",
       "      <td>sn02020801</td>\n",
       "      <td>XXX.XXX.XXX.10</td>\n",
       "      <td>XXX.XXX.XXX.229</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Cluster2</td>\n",
       "      <td>sn0202</td>\n",
       "      <td>sn02021601</td>\n",
       "      <td>XXX.XXX.XXX.6</td>\n",
       "      <td>XXX.XXX.XXX.227</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Cluster2</td>\n",
       "      <td>sn0203</td>\n",
       "      <td>sn02030801</td>\n",
       "      <td>XXX.XXX.XXX.22</td>\n",
       "      <td>XXX.XXX.XXX.235</td>\n",
       "      <td>16</td>\n",
       "      <td>65536</td>\n",
       "      <td>10.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>64512.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>TestCluster</td>\n",
       "      <td>vm</td>\n",
       "      <td>testvm001</td>\n",
       "      <td></td>\n",
       "      <td>XXX.XXX.XXX.70</td>\n",
       "      <td>2</td>\n",
       "      <td>10240</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>TestCluster</td>\n",
       "      <td>vm</td>\n",
       "      <td>testvm002</td>\n",
       "      <td></td>\n",
       "      <td>XXX.XXX.XXX.71</td>\n",
       "      <td>2</td>\n",
       "      <td>10240</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>TestCluster</td>\n",
       "      <td>vm</td>\n",
       "      <td>testvm003</td>\n",
       "      <td></td>\n",
       "      <td>XXX.XXX.XXX.72</td>\n",
       "      <td>2</td>\n",
       "      <td>10240</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>TestCluster</td>\n",
       "      <td>vm</td>\n",
       "      <td>testvm004</td>\n",
       "      <td></td>\n",
       "      <td>XXX.XXX.XXX.73</td>\n",
       "      <td>2</td>\n",
       "      <td>10240</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>4096.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>TestCluster</td>\n",
       "      <td>vm</td>\n",
       "      <td>testvm005</td>\n",
       "      <td></td>\n",
       "      <td>XXX.XXX.XXX.112</td>\n",
       "      <td>2</td>\n",
       "      <td>10240</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>4096.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>TestCluster</td>\n",
       "      <td>vm</td>\n",
       "      <td>testvm006</td>\n",
       "      <td></td>\n",
       "      <td>XXX.XXX.XXX.113</td>\n",
       "      <td>2</td>\n",
       "      <td>10240</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>4096.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>TestCluster</td>\n",
       "      <td>vm</td>\n",
       "      <td>testvm007</td>\n",
       "      <td></td>\n",
       "      <td>XXX.XXX.XXX.114</td>\n",
       "      <td>2</td>\n",
       "      <td>10240</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>4096.0</td>\n",
       "      <td>...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>27 rows × 30 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "        Cluster    Type        Name Internal IP     Service IP  VCPUs  \\\n",
       "0      Cluster1  cn0107  cn01070401  XXX.XXX.XXX.85  XXX.XXX.XXX.197     12   \n",
       "1      Cluster1  cn0107  cn01070402  XXX.XXX.XXX.86  XXX.XXX.XXX.198     12   \n",
       "2      Cluster1  cn0107  cn01070403  XXX.XXX.XXX.87  XXX.XXX.XXX.199     12   \n",
       "3      Cluster1  cn0107  cn01070404  XXX.XXX.XXX.88  XXX.XXX.XXX.200     12   \n",
       "4      Cluster1  cn0107  cn01070603  XXX.XXX.XXX.83  XXX.XXX.XXX.195     12   \n",
       "5      Cluster1  cn0107  cn01070604  XXX.XXX.XXX.84  XXX.XXX.XXX.196     12   \n",
       "6      Cluster1  sn0202  sn02020401  XXX.XXX.XXX.12  XXX.XXX.XXX.230     16   \n",
       "7      Cluster1  sn0202  sn02021201   XXX.XXX.XXX.8  XXX.XXX.XXX.228     16   \n",
       "8      Cluster1  sn0202  sn02022001   XXX.XXX.XXX.4  XXX.XXX.XXX.226     16   \n",
       "9      Cluster1  sn0202  sn02022401   XXX.XXX.XXX.2  XXX.XXX.XXX.225     16   \n",
       "10     Cluster1  sn0203  sn02030401  XXX.XXX.XXX.24  XXX.XXX.XXX.236     16   \n",
       "11     Cluster1  sn0203  sn02031201  XXX.XXX.XXX.20  XXX.XXX.XXX.234     16   \n",
       "12     Cluster1  sn0203  sn02032001  XXX.XXX.XXX.16  XXX.XXX.XXX.232     16   \n",
       "13     Cluster1  sn0203  sn02032401  XXX.XXX.XXX.14  XXX.XXX.XXX.231     16   \n",
       "14     Cluster1  sn0203  sn02031601  XXX.XXX.XXX.18  XXX.XXX.XXX.233     16   \n",
       "15     Cluster2  cn0107  cn01070601  XXX.XXX.XXX.81  XXX.XXX.XXX.193     12   \n",
       "16     Cluster2  cn0107  cn01070602  XXX.XXX.XXX.82  XXX.XXX.XXX.194     12   \n",
       "17     Cluster2  sn0202  sn02020801  XXX.XXX.XXX.10  XXX.XXX.XXX.229     16   \n",
       "18     Cluster2  sn0202  sn02021601   XXX.XXX.XXX.6  XXX.XXX.XXX.227     16   \n",
       "19     Cluster2  sn0203  sn02030801  XXX.XXX.XXX.22  XXX.XXX.XXX.235     16   \n",
       "20  TestCluster      vm   testvm001               XXX.XXX.XXX.70      2   \n",
       "21  TestCluster      vm   testvm002               XXX.XXX.XXX.71      2   \n",
       "22  TestCluster      vm   testvm003               XXX.XXX.XXX.72      2   \n",
       "23  TestCluster      vm   testvm004               XXX.XXX.XXX.73      2   \n",
       "24  TestCluster      vm   testvm005              XXX.XXX.XXX.112      2   \n",
       "25  TestCluster      vm   testvm006              XXX.XXX.XXX.113      2   \n",
       "26  TestCluster      vm   testvm007              XXX.XXX.XXX.114      2   \n",
       "\n",
       "    Memory(MiB)  DFS Volumes  YARN VCPUs  YARN Total Memory(MB)  ...    \\\n",
       "0         98304          NaN         NaN                    NaN  ...     \n",
       "1         98304          NaN         NaN                    NaN  ...     \n",
       "2         98304          NaN         NaN                    NaN  ...     \n",
       "3         98304          NaN         NaN                    NaN  ...     \n",
       "4         98304          NaN         NaN                    NaN  ...     \n",
       "5         98304          NaN         NaN                    NaN  ...     \n",
       "6         65536         10.0        15.0                64512.0  ...     \n",
       "7         65536         10.0        15.0                64512.0  ...     \n",
       "8         65536         10.0        15.0                64512.0  ...     \n",
       "9         65536         10.0        15.0                64512.0  ...     \n",
       "10        65536         10.0        15.0                64512.0  ...     \n",
       "11        65536         10.0        15.0                64512.0  ...     \n",
       "12        65536         10.0        15.0                64512.0  ...     \n",
       "13        65536         10.0        15.0                64512.0  ...     \n",
       "14        65536         10.0        15.0                64512.0  ...     \n",
       "15        98304         10.0        11.0                97280.0  ...     \n",
       "16        98304         10.0        11.0                97280.0  ...     \n",
       "17        65536         10.0        15.0                64512.0  ...     \n",
       "18        65536         10.0        15.0                64512.0  ...     \n",
       "19        65536         10.0        15.0                64512.0  ...     \n",
       "20        10240          NaN         NaN                    NaN  ...     \n",
       "21        10240          NaN         NaN                    NaN  ...     \n",
       "22        10240          NaN         NaN                    NaN  ...     \n",
       "23        10240          1.0         1.0                 4096.0  ...     \n",
       "24        10240          1.0         1.0                 4096.0  ...     \n",
       "25        10240          1.0         1.0                 4096.0  ...     \n",
       "26        10240          1.0         1.0                 4096.0  ...     \n",
       "\n",
       "   HBase RegionServer    Tez   Hive    Pig Client  Spark Spark HistoryServer  \\\n",
       "0               False  False  False  False  False  False               False   \n",
       "1               False  False  False  False  False  False               False   \n",
       "2               False  False  False  False  False  False               False   \n",
       "3               False   True   True   True   True   True                True   \n",
       "4               False  False  False  False  False  False               False   \n",
       "5               False  False  False  False  False  False               False   \n",
       "6                True  False  False  False  False  False               False   \n",
       "7                True  False  False  False  False  False               False   \n",
       "8                True  False  False  False  False  False               False   \n",
       "9                True  False  False  False  False  False               False   \n",
       "10               True  False  False  False  False  False               False   \n",
       "11               True  False  False  False  False  False               False   \n",
       "12               True  False  False  False  False  False               False   \n",
       "13               True  False  False  False  False  False               False   \n",
       "14               True  False  False  False  False  False               False   \n",
       "15              False  False  False  False  False  False               False   \n",
       "16              False   True   True   True   True   True                True   \n",
       "17               True  False  False  False  False  False               False   \n",
       "18               True  False  False  False  False  False               False   \n",
       "19               True  False  False  False  False  False               False   \n",
       "20              False  False  False  False  False  False               False   \n",
       "21              False  False  False  False  False  False               False   \n",
       "22              False   True   True   True   True   True                True   \n",
       "23               True  False  False  False  False  False               False   \n",
       "24               True  False  False  False  False  False               False   \n",
       "25               True  False  False  False  False  False               False   \n",
       "26               True  False  False  False  False  False               False   \n",
       "\n",
       "   KDC Master KDC Slave Docker  \n",
       "0        True     False  False  \n",
       "1       False      True  False  \n",
       "2       False     False  False  \n",
       "3       False     False  False  \n",
       "4       False     False   True  \n",
       "5       False     False   True  \n",
       "6       False     False  False  \n",
       "7       False     False  False  \n",
       "8       False     False  False  \n",
       "9       False     False  False  \n",
       "10      False     False  False  \n",
       "11      False     False  False  \n",
       "12      False     False  False  \n",
       "13      False     False  False  \n",
       "14      False     False  False  \n",
       "15      False      True  False  \n",
       "16       True     False  False  \n",
       "17      False     False  False  \n",
       "18      False     False  False  \n",
       "19      False     False  False  \n",
       "20      False     False  False  \n",
       "21      False     False  False  \n",
       "22      False     False  False  \n",
       "23      False     False  False  \n",
       "24      False     False  False  \n",
       "25      False     False  False  \n",
       "26      False     False  False  \n",
       "\n",
       "[27 rows x 30 columns]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%run scripts/loader.py\n",
    "\n",
    "header, machines = read_machines(hosts_csv)\n",
    "\n",
    "pd.DataFrame([get_row(header, m) for m in machines], columns=header)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "dependency": {
     "title": "Ansibleの設定を変える"
    },
    "lc_cell_meme": {
     "current": "a10d14fa-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d16bc-495a-11e8-9d32-0242ac130002",
     "previous": "a10d1392-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "# Ansible用ファイルの更新\n",
    "\n",
    "\n",
    "AnsibleにHadoop環境構築をおこなわせるため、以下の2つのファイルを更新します。\n",
    "\n",
    "- Inventory ... グループとホストの対応関係\n",
    "- group_vars ... 各Playbookに渡す変数\n",
    "\n",
    "このNotebookではInventoryのひな型のみを提供し、実際のマージは人手で行います。\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d16bc-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d18a6-495a-11e8-9d32-0242ac130002",
     "previous": "a10d14fa-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "## Inventoryの更新\n",
    "\n",
    "Inventoryをアップデートします。先に確認したホスト表に基づいて、グループ定義を含むInventoryの内容を生成します。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d18a6-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d1a72-495a-11e8-9d32-0242ac130002",
     "previous": "a10d16bc-495a-11e8-9d32-0242ac130002"
    },
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[hadoop_all_cluster1:children]\r\n",
      "hadoop_master_cluster1 \r\n",
      "hadoop_client_cluster1 \r\n",
      "hadoop_slavenode_cluster1 \r\n",
      "hadoop_hbase_cluster1 \r\n",
      "hadoop_spark_cluster1 \r\n",
      "\r\n",
      "[hadoop_swimlane_cluster1]\r\n",
      "XXX.XXX.XXX.200 \r\n",
      "\r\n",
      "[hadoop_master_cluster1:children]\r\n",
      "hadoop_namenode_cluster1 \r\n",
      "hadoop_journalnode_cluster1 \r\n",
      "hadoop_zookeeperserver_cluster1 \r\n",
      "hadoop_resourcemanager_cluster1 \r\n",
      "\r\n",
      "[hadoop_hbase_cluster1:children]\r\n",
      "hadoop_hbase_master_cluster1 \r\n",
      "hadoop_hbase_regionserver_cluster1 \r\n",
      "\r\n",
      "[hadoop_spark_history_cluster1]\r\n",
      "XXX.XXX.XXX.200 \r\n",
      "\r\n",
      "[hadoop_journalnode_cluster1]\r\n",
      "XXX.XXX.XXX.197 \r\n",
      "XXX.XXX.XXX.198 \r\n",
      "XXX.XXX.XXX.199 \r\n",
      "\r\n",
      "[hadoop_client_cluster1]\r\n",
      "XXX.XXX.XXX.200 \r\n",
      "\r\n",
      "[hadoop_zookeeperserver_cluster1]\r\n",
      "XXX.XXX.XXX.197 zookeeper_server_id=1\r\n",
      "XXX.XXX.XXX.198 zookeeper_server_id=2\r\n",
      "XXX.XXX.XXX.199 zookeeper_server_id=3\r\n",
      "\r\n",
      "[hadoop_namenode_cluster1:children]\r\n",
      "hadoop_namenode_primary_cluster1 \r\n",
      "hadoop_namenode_backup_cluster1 \r\n",
      "\r\n",
      "[kerberos_master_cluster1]\r\n",
      "XXX.XXX.XXX.197 \r\n",
      "\r\n",
      "[hadoop_hive_cluster1]\r\n",
      "XXX.XXX.XXX.200 \r\n",
      "\r\n",
      "[hadoop_hbase_regionserver_cluster1]\r\n",
      "XXX.XXX.XXX.230 \r\n",
      "XXX.XXX.XXX.228 \r\n",
      "XXX.XXX.XXX.226 \r\n",
      "XXX.XXX.XXX.225 \r\n",
      "XXX.XXX.XXX.236 \r\n",
      "XXX.XXX.XXX.234 \r\n",
      "XXX.XXX.XXX.232 \r\n",
      "XXX.XXX.XXX.231 \r\n",
      "XXX.XXX.XXX.233 \r\n",
      "\r\n",
      "[hadoop_namenode_backup_cluster1]\r\n",
      "XXX.XXX.XXX.198 \r\n",
      "\r\n",
      "[hadoop_resourcemanager_cluster1]\r\n",
      "XXX.XXX.XXX.197 \r\n",
      "XXX.XXX.XXX.198 \r\n",
      "\r\n",
      "[hadoop_mapreduce_historyserver_cluster1]\r\n",
      "XXX.XXX.XXX.200 \r\n",
      "\r\n",
      "[hadoop_pig_cluster1]\r\n",
      "XXX.XXX.XXX.200 \r\n",
      "\r\n",
      "[hadoop_hbase_master_cluster1]\r\n",
      "XXX.XXX.XXX.197 \r\n",
      "XXX.XXX.XXX.198 \r\n",
      "\r\n",
      "[hadoop_spark_cluster1]\r\n",
      "XXX.XXX.XXX.200 \r\n",
      "\r\n",
      "[hadoop_slavenode_cluster1]\r\n",
      "XXX.XXX.XXX.230 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.228 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.226 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.225 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.236 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.234 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.232 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.231 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.233 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "\r\n",
      "[hadoop_timelineservice_cluster1]\r\n",
      "XXX.XXX.XXX.199 \r\n",
      "\r\n",
      "[hadoop_namenode_primary_cluster1]\r\n",
      "XXX.XXX.XXX.197 \r\n",
      "\r\n",
      "[hadoop_tez_cluster1]\r\n",
      "XXX.XXX.XXX.200 \r\n",
      "\r\n",
      "[hadoop_all_cluster2:children]\r\n",
      "hadoop_master_cluster2 \r\n",
      "hadoop_client_cluster2 \r\n",
      "hadoop_slavenode_cluster2 \r\n",
      "hadoop_hbase_cluster2 \r\n",
      "hadoop_spark_cluster2 \r\n",
      "\r\n",
      "[hadoop_swimlane_cluster2]\r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_master_cluster2:children]\r\n",
      "hadoop_namenode_cluster2 \r\n",
      "hadoop_journalnode_cluster2 \r\n",
      "hadoop_zookeeperserver_cluster2 \r\n",
      "hadoop_resourcemanager_cluster2 \r\n",
      "\r\n",
      "[hadoop_hbase_cluster2:children]\r\n",
      "hadoop_hbase_master_cluster2 \r\n",
      "hadoop_hbase_regionserver_cluster2 \r\n",
      "\r\n",
      "[hadoop_spark_history_cluster2]\r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_journalnode_cluster2]\r\n",
      "XXX.XXX.XXX.193 \r\n",
      "XXX.XXX.XXX.194 \r\n",
      "XXX.XXX.XXX.229 \r\n",
      "\r\n",
      "[hadoop_client_cluster2]\r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_zookeeperserver_cluster2]\r\n",
      "XXX.XXX.XXX.193 zookeeper_server_id=1\r\n",
      "XXX.XXX.XXX.194 zookeeper_server_id=2\r\n",
      "XXX.XXX.XXX.229 zookeeper_server_id=3\r\n",
      "\r\n",
      "[hadoop_namenode_cluster2:children]\r\n",
      "hadoop_namenode_primary_cluster2 \r\n",
      "hadoop_namenode_backup_cluster2 \r\n",
      "\r\n",
      "[kerberos_master_cluster2]\r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_hive_cluster2]\r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_hbase_regionserver_cluster2]\r\n",
      "XXX.XXX.XXX.229 \r\n",
      "XXX.XXX.XXX.227 \r\n",
      "XXX.XXX.XXX.235 \r\n",
      "\r\n",
      "[hadoop_namenode_backup_cluster2]\r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_resourcemanager_cluster2]\r\n",
      "XXX.XXX.XXX.193 \r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_mapreduce_historyserver_cluster2]\r\n",
      "XXX.XXX.XXX.229 \r\n",
      "\r\n",
      "[hadoop_pig_cluster2]\r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_hbase_master_cluster2]\r\n",
      "XXX.XXX.XXX.193 \r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_spark_cluster2]\r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_slavenode_cluster2]\r\n",
      "XXX.XXX.XXX.229 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.227 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "XXX.XXX.XXX.235 yarn_nodemanager_resource_cpu_vcores=15 yarn_nodemanager_resource_memory_mb=64512 \r\n",
      "\r\n",
      "[hadoop_timelineservice_cluster2]\r\n",
      "XXX.XXX.XXX.193 \r\n",
      "\r\n",
      "[hadoop_namenode_primary_cluster2]\r\n",
      "XXX.XXX.XXX.193 \r\n",
      "\r\n",
      "[hadoop_tez_cluster2]\r\n",
      "XXX.XXX.XXX.194 \r\n",
      "\r\n",
      "[hadoop_all_testcluster:children]\r\n",
      "hadoop_master_testcluster \r\n",
      "hadoop_client_testcluster \r\n",
      "hadoop_slavenode_testcluster \r\n",
      "hadoop_hbase_testcluster \r\n",
      "hadoop_spark_testcluster \r\n",
      "\r\n",
      "[hadoop_swimlane_testcluster]\r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_master_testcluster:children]\r\n",
      "hadoop_namenode_testcluster \r\n",
      "hadoop_journalnode_testcluster \r\n",
      "hadoop_zookeeperserver_testcluster \r\n",
      "hadoop_resourcemanager_testcluster \r\n",
      "\r\n",
      "[hadoop_hbase_testcluster:children]\r\n",
      "hadoop_hbase_master_testcluster \r\n",
      "hadoop_hbase_regionserver_testcluster \r\n",
      "\r\n",
      "[hadoop_spark_history_testcluster]\r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_journalnode_testcluster]\r\n",
      "XXX.XXX.XXX.70 \r\n",
      "XXX.XXX.XXX.71 \r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_client_testcluster]\r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_zookeeperserver_testcluster]\r\n",
      "XXX.XXX.XXX.70 zookeeper_server_id=1\r\n",
      "XXX.XXX.XXX.71 zookeeper_server_id=2\r\n",
      "XXX.XXX.XXX.72 zookeeper_server_id=3\r\n",
      "\r\n",
      "[hadoop_namenode_testcluster:children]\r\n",
      "hadoop_namenode_primary_testcluster \r\n",
      "hadoop_namenode_backup_testcluster \r\n",
      "\r\n",
      "[hadoop_hive_testcluster]\r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_hbase_regionserver_testcluster]\r\n",
      "XXX.XXX.XXX.73 \r\n",
      "XXX.XXX.XXX.112 \r\n",
      "XXX.XXX.XXX.113 \r\n",
      "XXX.XXX.XXX.114 \r\n",
      "\r\n",
      "[hadoop_namenode_backup_testcluster]\r\n",
      "XXX.XXX.XXX.71 \r\n",
      "\r\n",
      "[hadoop_resourcemanager_testcluster]\r\n",
      "XXX.XXX.XXX.70 \r\n",
      "XXX.XXX.XXX.71 \r\n",
      "\r\n",
      "[hadoop_mapreduce_historyserver_testcluster]\r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_pig_testcluster]\r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_hbase_master_testcluster]\r\n",
      "XXX.XXX.XXX.70 \r\n",
      "XXX.XXX.XXX.71 \r\n",
      "\r\n",
      "[hadoop_spark_testcluster]\r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_slavenode_testcluster]\r\n",
      "XXX.XXX.XXX.73 yarn_nodemanager_resource_cpu_vcores=1 yarn_nodemanager_resource_memory_mb=4096 \r\n",
      "XXX.XXX.XXX.112 yarn_nodemanager_resource_cpu_vcores=1 yarn_nodemanager_resource_memory_mb=4096 \r\n",
      "XXX.XXX.XXX.113 yarn_nodemanager_resource_cpu_vcores=1 yarn_nodemanager_resource_memory_mb=4096 \r\n",
      "XXX.XXX.XXX.114 yarn_nodemanager_resource_cpu_vcores=1 yarn_nodemanager_resource_memory_mb=4096 \r\n",
      "\r\n",
      "[hadoop_timelineservice_testcluster]\r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_namenode_primary_testcluster]\r\n",
      "XXX.XXX.XXX.70 \r\n",
      "\r\n",
      "[hadoop_tez_testcluster]\r\n",
      "XXX.XXX.XXX.72 \r\n",
      "\r\n",
      "[hadoop_all:children]\r\n",
      "hadoop_all_cluster1\r\n",
      "hadoop_all_cluster2\r\n",
      "hadoop_all_testcluster\r\n",
      "\r\n",
      "[hadoop_client:children]\r\n",
      "hadoop_client_cluster1\r\n",
      "hadoop_client_cluster2\r\n",
      "hadoop_client_testcluster\r\n",
      "\r\n",
      "[hadoop_hbase:children]\r\n",
      "hadoop_hbase_cluster1\r\n",
      "hadoop_hbase_cluster2\r\n",
      "hadoop_hbase_testcluster\r\n",
      "\r\n",
      "[hadoop_hbase_master:children]\r\n",
      "hadoop_hbase_master_cluster1\r\n",
      "hadoop_hbase_master_cluster2\r\n",
      "hadoop_hbase_master_testcluster\r\n",
      "\r\n",
      "[hadoop_hbase_regionserver:children]\r\n",
      "hadoop_hbase_regionserver_cluster1\r\n",
      "hadoop_hbase_regionserver_cluster2\r\n",
      "hadoop_hbase_regionserver_testcluster\r\n",
      "\r\n",
      "[hadoop_hive:children]\r\n",
      "hadoop_hive_cluster1\r\n",
      "hadoop_hive_cluster2\r\n",
      "hadoop_hive_testcluster\r\n",
      "\r\n",
      "[hadoop_journalnode:children]\r\n",
      "hadoop_journalnode_cluster1\r\n",
      "hadoop_journalnode_cluster2\r\n",
      "hadoop_journalnode_testcluster\r\n",
      "\r\n",
      "[hadoop_mapreduce_historyserver:children]\r\n",
      "hadoop_mapreduce_historyserver_cluster1\r\n",
      "hadoop_mapreduce_historyserver_cluster2\r\n",
      "hadoop_mapreduce_historyserver_testcluster\r\n",
      "\r\n",
      "[hadoop_master:children]\r\n",
      "hadoop_master_cluster1\r\n",
      "hadoop_master_cluster2\r\n",
      "hadoop_master_testcluster\r\n",
      "\r\n",
      "[hadoop_namenode:children]\r\n",
      "hadoop_namenode_cluster1\r\n",
      "hadoop_namenode_cluster2\r\n",
      "hadoop_namenode_testcluster\r\n",
      "\r\n",
      "[hadoop_namenode_backup:children]\r\n",
      "hadoop_namenode_backup_cluster1\r\n",
      "hadoop_namenode_backup_cluster2\r\n",
      "hadoop_namenode_backup_testcluster\r\n",
      "\r\n",
      "[hadoop_namenode_primary:children]\r\n",
      "hadoop_namenode_primary_cluster1\r\n",
      "hadoop_namenode_primary_cluster2\r\n",
      "hadoop_namenode_primary_testcluster\r\n",
      "\r\n",
      "[hadoop_pig:children]\r\n",
      "hadoop_pig_cluster1\r\n",
      "hadoop_pig_cluster2\r\n",
      "hadoop_pig_testcluster\r\n",
      "\r\n",
      "[hadoop_resourcemanager:children]\r\n",
      "hadoop_resourcemanager_cluster1\r\n",
      "hadoop_resourcemanager_cluster2\r\n",
      "hadoop_resourcemanager_testcluster\r\n",
      "\r\n",
      "[hadoop_slavenode:children]\r\n",
      "hadoop_slavenode_cluster1\r\n",
      "hadoop_slavenode_cluster2\r\n",
      "hadoop_slavenode_testcluster\r\n",
      "\r\n",
      "[hadoop_spark:children]\r\n",
      "hadoop_spark_cluster1\r\n",
      "hadoop_spark_cluster2\r\n",
      "hadoop_spark_testcluster\r\n",
      "\r\n",
      "[hadoop_spark_history:children]\r\n",
      "hadoop_spark_history_cluster1\r\n",
      "hadoop_spark_history_cluster2\r\n",
      "hadoop_spark_history_testcluster\r\n",
      "\r\n",
      "[hadoop_swimlane:children]\r\n",
      "hadoop_swimlane_cluster1\r\n",
      "hadoop_swimlane_cluster2\r\n",
      "hadoop_swimlane_testcluster\r\n",
      "\r\n",
      "[hadoop_tez:children]\r\n",
      "hadoop_tez_cluster1\r\n",
      "hadoop_tez_cluster2\r\n",
      "hadoop_tez_testcluster\r\n",
      "\r\n",
      "[hadoop_timelineservice:children]\r\n",
      "hadoop_timelineservice_cluster1\r\n",
      "hadoop_timelineservice_cluster2\r\n",
      "hadoop_timelineservice_testcluster\r\n",
      "\r\n",
      "[hadoop_zookeeperserver:children]\r\n",
      "hadoop_zookeeperserver_cluster1\r\n",
      "hadoop_zookeeperserver_cluster2\r\n",
      "hadoop_zookeeperserver_testcluster\r\n",
      "\r\n",
      "[kerberos_master:children]\r\n",
      "kerberos_master_cluster1\r\n",
      "kerberos_master_cluster2\r\n",
      "\r\n"
     ]
    }
   ],
   "source": [
    "%run scripts/inventory-hadoop.py\n",
    "\n",
    "with open('{work_dir}/hosts'.format(work_dir=work_dir), \"w\") as f:\n",
    "    aliases = []\n",
    "    for cluster in sorted(set(map(lambda m: m['Cluster'], machines))):\n",
    "        aliases += write_hadoop_inventory(filter(lambda m: m['Cluster'] == cluster, machines), f)\n",
    "    for group in sorted(set(map(lambda a: a[0], aliases))):\n",
    "        f.write('''[{group}:children]\n",
    "{targets}\n",
    "\n",
    "'''.format(group=group, targets='\\n'.join(map(lambda a: a[1], filter(lambda a: a[0] == group, aliases)))))\n",
    "\n",
    "!cat {work_dir}/hosts"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d1a72-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d1f0e-495a-11e8-9d32-0242ac130002",
     "previous": "a10d18a6-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "上の出力結果を、Inventoryに反映します。すでにInventoryには別のマシンに関する情報もある可能性を考慮し、手作業でのマージとします。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true,
    "lc_cell_meme": {
     "current": "a10d1f0e-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d2134-495a-11e8-9d32-0242ac130002",
     "previous": "a10d1a72-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [],
   "source": [
    "!cp inventory {work_dir}/inventory-old"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d2134-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d22c4-495a-11e8-9d32-0242ac130002",
     "previous": "a10d1f0e-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "[Inventory](../edit/inventory) を修正する。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d22c4-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d23fa-495a-11e8-9d32-0242ac130002",
     "previous": "a10d2134-495a-11e8-9d32-0242ac130002"
    },
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "--- /tmp/tmpC7TYKk/inventory-old\t2016-08-26 11:28:11.990651381 +0900\r\n",
      "+++ inventory\t2016-08-26 11:28:47.486954290 +0900\r\n",
      "@@ -196,89 +196,194 @@\r\n",
      " [hadoop_tez_cluster2]\r\n",
      " XXX.XXX.XXX.194 \r\n",
      " \r\n",
      "+[hadoop_all_testcluster:children]\r\n",
      "+hadoop_master_testcluster \r\n",
      "+hadoop_client_testcluster \r\n",
      "+hadoop_slavenode_testcluster \r\n",
      "+hadoop_hbase_testcluster \r\n",
      "+hadoop_spark_testcluster \r\n",
      "+\r\n",
      "+[hadoop_swimlane_testcluster]\r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      "+[hadoop_master_testcluster:children]\r\n",
      "+hadoop_namenode_testcluster \r\n",
      "+hadoop_journalnode_testcluster \r\n",
      "+hadoop_zookeeperserver_testcluster \r\n",
      "+hadoop_resourcemanager_testcluster \r\n",
      "+\r\n",
      "+[hadoop_hbase_testcluster:children]\r\n",
      "+hadoop_hbase_master_testcluster \r\n",
      "+hadoop_hbase_regionserver_testcluster \r\n",
      "+\r\n",
      "+[hadoop_spark_history_testcluster]\r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      "+[hadoop_journalnode_testcluster]\r\n",
      "+XXX.XXX.XXX.70 \r\n",
      "+XXX.XXX.XXX.71 \r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      "+[hadoop_client_testcluster]\r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      "+[hadoop_zookeeperserver_testcluster]\r\n",
      "+XXX.XXX.XXX.70 zookeeper_server_id=1\r\n",
      "+XXX.XXX.XXX.71 zookeeper_server_id=2\r\n",
      "+XXX.XXX.XXX.72 zookeeper_server_id=3\r\n",
      "+\r\n",
      "+[hadoop_namenode_testcluster:children]\r\n",
      "+hadoop_namenode_primary_testcluster \r\n",
      "+hadoop_namenode_backup_testcluster \r\n",
      "+\r\n",
      "+[hadoop_hive_testcluster]\r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      "+[hadoop_hbase_regionserver_testcluster]\r\n",
      "+XXX.XXX.XXX.73 \r\n",
      "+XXX.XXX.XXX.112 \r\n",
      "+XXX.XXX.XXX.113 \r\n",
      "+XXX.XXX.XXX.114 \r\n",
      "+\r\n",
      "+[hadoop_namenode_backup_testcluster]\r\n",
      "+XXX.XXX.XXX.71 \r\n",
      "+\r\n",
      "+[hadoop_resourcemanager_testcluster]\r\n",
      "+XXX.XXX.XXX.70 \r\n",
      "+XXX.XXX.XXX.71 \r\n",
      "+\r\n",
      "+[hadoop_mapreduce_historyserver_testcluster]\r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      "+[hadoop_pig_testcluster]\r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      "+[hadoop_hbase_master_testcluster]\r\n",
      "+XXX.XXX.XXX.70 \r\n",
      "+XXX.XXX.XXX.71 \r\n",
      "+\r\n",
      "+[hadoop_spark_testcluster]\r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      "+[hadoop_slavenode_testcluster]\r\n",
      "+XXX.XXX.XXX.73 yarn_nodemanager_resource_cpu_vcores=1 yarn_nodemanager_resource_memory_mb=4096 \r\n",
      "+XXX.XXX.XXX.112 yarn_nodemanager_resource_cpu_vcores=1 yarn_nodemanager_resource_memory_mb=4096 \r\n",
      "+XXX.XXX.XXX.113 yarn_nodemanager_resource_cpu_vcores=1 yarn_nodemanager_resource_memory_mb=4096 \r\n",
      "+XXX.XXX.XXX.114 yarn_nodemanager_resource_cpu_vcores=1 yarn_nodemanager_resource_memory_mb=4096 \r\n",
      "+\r\n",
      "+[hadoop_timelineservice_testcluster]\r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      "+[hadoop_namenode_primary_testcluster]\r\n",
      "+XXX.XXX.XXX.70 \r\n",
      "+\r\n",
      "+[hadoop_tez_testcluster]\r\n",
      "+XXX.XXX.XXX.72 \r\n",
      "+\r\n",
      " [hadoop_all:children]\r\n",
      " hadoop_all_cluster1\r\n",
      " hadoop_all_cluster2\r\n",
      "+hadoop_all_testcluster\r\n",
      " \r\n",
      " [hadoop_client:children]\r\n",
      " hadoop_client_cluster1\r\n",
      " hadoop_client_cluster2\r\n",
      "+hadoop_client_testcluster\r\n",
      " \r\n",
      " [hadoop_hbase:children]\r\n",
      " hadoop_hbase_cluster1\r\n",
      " hadoop_hbase_cluster2\r\n",
      "+hadoop_hbase_testcluster\r\n",
      " \r\n",
      " [hadoop_hbase_master:children]\r\n",
      " hadoop_hbase_master_cluster1\r\n",
      " hadoop_hbase_master_cluster2\r\n",
      "+hadoop_hbase_master_testcluster\r\n",
      " \r\n",
      " [hadoop_hbase_regionserver:children]\r\n",
      " hadoop_hbase_regionserver_cluster1\r\n",
      " hadoop_hbase_regionserver_cluster2\r\n",
      "+hadoop_hbase_regionserver_testcluster\r\n",
      " \r\n",
      " [hadoop_hive:children]\r\n",
      " hadoop_hive_cluster1\r\n",
      " hadoop_hive_cluster2\r\n",
      "+hadoop_hive_testcluster\r\n",
      " \r\n",
      " [hadoop_journalnode:children]\r\n",
      " hadoop_journalnode_cluster1\r\n",
      " hadoop_journalnode_cluster2\r\n",
      "+hadoop_journalnode_testcluster\r\n",
      " \r\n",
      " [hadoop_mapreduce_historyserver:children]\r\n",
      " hadoop_mapreduce_historyserver_cluster1\r\n",
      " hadoop_mapreduce_historyserver_cluster2\r\n",
      "+hadoop_mapreduce_historyserver_testcluster\r\n",
      " \r\n",
      " [hadoop_master:children]\r\n",
      " hadoop_master_cluster1\r\n",
      " hadoop_master_cluster2\r\n",
      "+hadoop_master_testcluster\r\n",
      " \r\n",
      " [hadoop_namenode:children]\r\n",
      " hadoop_namenode_cluster1\r\n",
      " hadoop_namenode_cluster2\r\n",
      "+hadoop_namenode_testcluster\r\n",
      " \r\n",
      " [hadoop_namenode_backup:children]\r\n",
      " hadoop_namenode_backup_cluster1\r\n",
      " hadoop_namenode_backup_cluster2\r\n",
      "+hadoop_namenode_backup_testcluster\r\n",
      " \r\n",
      " [hadoop_namenode_primary:children]\r\n",
      " hadoop_namenode_primary_cluster1\r\n",
      " hadoop_namenode_primary_cluster2\r\n",
      "+hadoop_namenode_primary_testcluster\r\n",
      " \r\n",
      " [hadoop_pig:children]\r\n",
      " hadoop_pig_cluster1\r\n",
      " hadoop_pig_cluster2\r\n",
      "+hadoop_pig_testcluster\r\n",
      " \r\n",
      " [hadoop_resourcemanager:children]\r\n",
      " hadoop_resourcemanager_cluster1\r\n",
      " hadoop_resourcemanager_cluster2\r\n",
      "+hadoop_resourcemanager_testcluster\r\n",
      " \r\n",
      " [hadoop_slavenode:children]\r\n",
      " hadoop_slavenode_cluster1\r\n",
      " hadoop_slavenode_cluster2\r\n",
      "+hadoop_slavenode_testcluster\r\n",
      " \r\n",
      " [hadoop_spark:children]\r\n",
      " hadoop_spark_cluster1\r\n",
      " hadoop_spark_cluster2\r\n",
      "+hadoop_spark_testcluster\r\n",
      " \r\n",
      " [hadoop_spark_history:children]\r\n",
      " hadoop_spark_history_cluster1\r\n",
      " hadoop_spark_history_cluster2\r\n",
      "+hadoop_spark_history_testcluster\r\n",
      " \r\n",
      " [hadoop_swimlane:children]\r\n",
      " hadoop_swimlane_cluster1\r\n",
      " hadoop_swimlane_cluster2\r\n",
      "+hadoop_swimlane_testcluster\r\n",
      " \r\n",
      " [hadoop_tez:children]\r\n",
      " hadoop_tez_cluster1\r\n",
      " hadoop_tez_cluster2\r\n",
      "+hadoop_tez_testcluster\r\n",
      " \r\n",
      " [hadoop_timelineservice:children]\r\n",
      " hadoop_timelineservice_cluster1\r\n",
      " hadoop_timelineservice_cluster2\r\n",
      "+hadoop_timelineservice_testcluster\r\n",
      " \r\n",
      " [hadoop_zookeeperserver:children]\r\n",
      " hadoop_zookeeperserver_cluster1\r\n",
      " hadoop_zookeeperserver_cluster2\r\n",
      "+hadoop_zookeeperserver_testcluster\r\n",
      " \r\n",
      " [kerberos_master:children]\r\n",
      " kerberos_master_cluster1\r\n"
     ]
    }
   ],
   "source": [
    "!diff -ur {work_dir}/inventory-old inventory"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d23fa-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d2530-495a-11e8-9d32-0242ac130002",
     "previous": "a10d22c4-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "hadoop_all グループでHadoopクラスタに所属するサーバすべてに疎通することを確認する。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d2530-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d265c-495a-11e8-9d32-0242ac130002",
     "previous": "a10d23fa-495a-11e8-9d32-0242ac130002"
    },
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[0;32mXXX.XXX.XXX.197 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.198 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.199 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.200 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.230 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.228 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.226 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.225 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.236 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.234 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.232 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.231 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.193 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.233 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.194 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.229 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.227 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.235 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.70 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.72 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.71 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.73 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.112 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.113 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mXXX.XXX.XXX.114 | SUCCESS => {\n",
      "    \"changed\": false, \n",
      "    \"ping\": \"pong\"\n",
      "}\u001b[0m\n"
     ]
    }
   ],
   "source": [
    "!ansible -m ping hadoop_all"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d265c-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d2788-495a-11e8-9d32-0242ac130002",
     "previous": "a10d2530-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "## グループ変数定義(hadoop\\_all\\_{cluster})の生成"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": true,
    "lc_cell_meme": {
     "current": "a10d2788-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d28b4-495a-11e8-9d32-0242ac130002",
     "previous": "a10d265c-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [],
   "source": [
    "archive_url = 'http://xxx.xxx.nii.ac.jp:YYYY/v1/AUTH_XXXXXXXXXXXXXXXXXXXXXXXX/HDP-2.x/archive'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d28b4-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d29e0-495a-11e8-9d32-0242ac130002",
     "previous": "a10d2788-495a-11e8-9d32-0242ac130002"
    },
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\r\n",
      "# HDP repository\r\n",
      "hdp_version: 'XXX.XXX.XXX.0-258'\r\n",
      "base_hdp_hdp_baseurl: 'http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/XXX.XXX.XXX.0'\r\n",
      "base_hdp_hdp_gpgcheck: '1'\r\n",
      "base_hdp_hdp_gpgkeyurl: 'http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/XXX.XXX.XXX.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins'\r\n",
      "base_hdp_util_baseurl: 'http://public-repo-1.hortonworks.com/HDP-UTILS-XXX.XXX.XXX.20/repos/centos6'\r\n",
      "base_hdp_util_gpgcheck: '1'\r\n",
      "base_hdp_util_gpgkeyurl: 'http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/XXX.XXX.XXX.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins'\r\n",
      "\r\n",
      "# define servers\r\n",
      "gmond: 'XXX.XXX.XXX.70'\r\n",
      "ganglia_cluster: 'TestCluster'\r\n",
      "ganglia_master: 'XXX.XXX.XXX.70'\r\n",
      "\r\n",
      "zookeeper_servers:\r\n",
      "  - 'testvm001'\r\n",
      "  - 'testvm002'\r\n",
      "  - 'testvm003'\r\n",
      "\r\n",
      "hadoop_namenode_servers:\r\n",
      "  - 'testvm001'\r\n",
      "  - 'testvm002'\r\n",
      "\r\n",
      "hadoop_slavenode_servers:\r\n",
      "  - 'testvm004'\r\n",
      "  - 'testvm005'\r\n",
      "  - 'testvm006'\r\n",
      "  - 'testvm007'\r\n",
      "\r\n",
      "hadoop_journalnode_servers:\r\n",
      "  - 'testvm001'\r\n",
      "  - 'testvm002'\r\n",
      "  - 'testvm003'\r\n",
      "\r\n",
      "hadoop_resourcemanager_servers:\r\n",
      "  - 'testvm001'\r\n",
      "  - 'testvm002'\r\n",
      "\r\n",
      "hadoop_timelineservice_server: 'testvm003'\r\n",
      "\r\n",
      "mapreduce_historyserver_address: 'testvm003'\r\n",
      "\r\n",
      "# cgroups\r\n",
      "cgroups_scripts_dir: '/var/local/cgroups'\r\n",
      "\r\n",
      "# Java\r\n",
      "jdk7_downloadurl: 'http://xxx.xxx.nii.ac.jp:YYYY/v1/AUTH_XXXXXXXXXXXXXXXXXXXXXXXX/HDP-2.x/archive'\r\n",
      "jdk8_downloadurl: 'http://xxx.xxx.nii.ac.jp:YYYY/v1/AUTH_XXXXXXXXXXXXXXXXXXXXXXXX/HDP-2.x/archive'\r\n",
      "# Swimlane\r\n",
      "swimlane_tez_version: '0.8.4'\r\n",
      "\r\n",
      "# HDFS\r\n",
      "dfs_namenode_name_dirs:\r\n",
      "  - '/hadoop/data/dfs/namedir'\r\n",
      "  \r\n",
      "dfs_datanode_data_dirs:\r\n",
      "  - '/hadoop/data01/dfs/datadir'\r\n",
      "dfs_replication: '3'\r\n",
      "dfs_journalnode_edits_dir: '/hadoop/data/jn'\r\n",
      "\r\n",
      "# HBase\r\n",
      "hbase_root_dir: '/hbase'\r\n",
      "\r\n",
      "# Hive\r\n",
      "hive_metastore_dir: '/hadoop/data/hive/metastore'\r\n",
      "\r\n",
      "# Zookeeper\r\n",
      "zookeeper_data_dir: '/hadoop/zookeeper'\r\n",
      "\r\n",
      "# YARN\r\n",
      "yarn_nodemanager_delete_debug_delay_sec: '3600'\r\n",
      "mapreduce_am_resource_mb: 4096\r\n",
      "mapreduce_am_command_opts: \"-Xmx3840m\"\r\n",
      "mapreduce_map_memory_mb: 4096\r\n",
      "mapreduce_map_java_opts: \"-Xmx3840m\"\r\n",
      "mapreduce_reduce_memory_mb: 4096\r\n",
      "mapreduce_reduce_java_opts: \"-Xmx3840m\"\r\n",
      "\r\n",
      "# Spark\r\n",
      "spark_download_url: 'http://xxx.xxx.nii.ac.jp:YYYY/v1/AUTH_XXXXXXXXXXXXXXXXXXXXXXXX/HDP-2.x/archive'\r\n",
      "spark_history_server_host: 'testvm003'\r\n"
     ]
    }
   ],
   "source": [
    "!mkdir -p {work_dir}/group_vars\n",
    "\n",
    "for cluster in sorted(set(map(lambda m: m['Cluster'], machines))):\n",
    "    with open(\"{work_dir}/group_vars/hadoop_all_{cluster}\".format(work_dir=work_dir, cluster=cluster.lower()), \"w\") as f:\n",
    "        write_hadoop_group_vars(filter(lambda m: m['Cluster'] == cluster, machines), f, archive_url)\n",
    "    \n",
    "!cat {work_dir}/group_vars/hadoop_all_testcluster"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d29e0-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d2b02-495a-11e8-9d32-0242ac130002",
     "previous": "a10d28b4-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "このファイルをInventoryと同じディレクトリ配下の[group_vars](../tree/group_vars/)ディレクトリに配置する。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": true,
    "lc_cell_meme": {
     "current": "a10d2b02-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d2c2e-495a-11e8-9d32-0242ac130002",
     "previous": "a10d29e0-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [],
   "source": [
    "!cp {work_dir}/group_vars/hadoop_all_testcluster group_vars/"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d2c2e-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d2d5a-495a-11e8-9d32-0242ac130002",
     "previous": "a10d2b02-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "total 36\r\n",
      "drwxr-xr-x  3 root root  4096 Aug 26 11:30 .\r\n",
      "drwxr-xr-x 19 root root 12288 Aug 26 11:30 ..\r\n",
      "-rw-r--r--  1 root root    71 Jul 29 12:03 docker_host\r\n",
      "-rw-r--r--  1 root root     0 Aug 22 11:35 .gitkeep\r\n",
      "-rw-r--r--  1 root root  2985 Aug  8 14:25 hadoop_all_cluster1\r\n",
      "-rw-r--r--  1 root root  2883 Jul 28 14:01 hadoop_all_cluster2\r\n",
      "-rw-r--r--  1 root root  2179 Aug 26 11:30 hadoop_all_testcluster\r\n",
      "drwxr-xr-x  2 root root  4096 Jul 29 12:02 .ipynb_checkpoints\r\n"
     ]
    }
   ],
   "source": [
    "!ls -la group_vars/"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true,
    "lc_cell_meme": {
     "current": "a10d2d5a-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d2e72-495a-11e8-9d32-0242ac130002",
     "previous": "a10d2c2e-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "# 動作確認\n",
    "\n",
    "変数が読み込まれていることを確認する。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d2e72-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d2fc6-495a-11e8-9d32-0242ac130002",
     "previous": "a10d2d5a-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Writing /tmp/tmpC7TYKk/test.yml\n"
     ]
    }
   ],
   "source": [
    "%%writefile {work_dir}/test.yml\n",
    "- hosts: hadoop_all\n",
    "  tasks:\n",
    "    - debug: msg={{ hadoop_timelineservice_server }}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d2fc6-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d30e8-495a-11e8-9d32-0242ac130002",
     "previous": "a10d2e72-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "PLAY [hadoop_all] **************************************************************\n",
      "\n",
      "TASK [setup] *******************************************************************\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.197]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.198]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.199]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.200]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.230]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.228]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.226]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.225]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.236]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.234]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.232]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.231]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.193]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.194]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.233]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.229]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.227]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.235]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.70]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.71]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.73]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.72]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.112]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.114]\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.113]\u001b[0m\n",
      "\n",
      "TASK [debug] *******************************************************************\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.197] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.198] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.199] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.200] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.230] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.228] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.226] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.225] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.236] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.234] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.232] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.231] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.233] => {\n",
      "    \"msg\": \"cn01070403\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.193] => {\n",
      "    \"msg\": \"cn01070601\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.194] => {\n",
      "    \"msg\": \"cn01070601\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.229] => {\n",
      "    \"msg\": \"cn01070601\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.227] => {\n",
      "    \"msg\": \"cn01070601\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.235] => {\n",
      "    \"msg\": \"cn01070601\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.70] => {\n",
      "    \"msg\": \"testvm003\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.71] => {\n",
      "    \"msg\": \"testvm003\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.72] => {\n",
      "    \"msg\": \"testvm003\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.73] => {\n",
      "    \"msg\": \"testvm003\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.112] => {\n",
      "    \"msg\": \"testvm003\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.113] => {\n",
      "    \"msg\": \"testvm003\"\n",
      "}\u001b[0m\n",
      "\u001b[0;32mok: [XXX.XXX.XXX.114] => {\n",
      "    \"msg\": \"testvm003\"\n",
      "}\u001b[0m\n",
      "\n",
      "PLAY RECAP *********************************************************************\n",
      "\u001b[0;32mXXX.XXX.XXX.193\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.194\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.197\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.198\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.199\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.200\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.225\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.226\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.227\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.228\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.229\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.230\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.231\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.232\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.233\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.234\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.235\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.236\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.112\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.113\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.114\u001b[0m              : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.70\u001b[0m               : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.71\u001b[0m               : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.72\u001b[0m               : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\u001b[0;32mXXX.XXX.XXX.73\u001b[0m               : \u001b[0;32mok\u001b[0m\u001b[0;32m=\u001b[0m\u001b[0;32m2\u001b[0m    changed=0    unreachable=0    failed=0   \n",
      "\n"
     ]
    }
   ],
   "source": [
    "!ansible-playbook {work_dir}/test.yml"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d30e8-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d320a-495a-11e8-9d32-0242ac130002",
     "previous": "a10d2fc6-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "OK。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "lc_cell_meme": {
     "current": "a10d320a-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d3340-495a-11e8-9d32-0242ac130002",
     "previous": "a10d30e8-495a-11e8-9d32-0242ac130002"
    }
   },
   "source": [
    "# 後始末\n",
    "\n",
    "一時ディレクトリを削除する。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": true,
    "lc_cell_meme": {
     "current": "a10d3340-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": "a10d349e-495a-11e8-9d32-0242ac130002",
     "previous": "a10d320a-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [],
   "source": [
    "!rm -fr {work_dir}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true,
    "lc_cell_meme": {
     "current": "a10d349e-495a-11e8-9d32-0242ac130002",
     "history": [],
     "next": null,
     "previous": "a10d3340-495a-11e8-9d32-0242ac130002"
    }
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 2",
   "language": "python",
   "name": "python2"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 2
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython2",
   "version": "2.7.9"
  },
  "lc_notebook_meme": {
   "current": "a10d0262-495a-11e8-9d32-0242ac130002",
   "history": [],
   "root_cells": [
    "a10d04ba-495a-11e8-9d32-0242ac130002",
    "a10d062c-495a-11e8-9d32-0242ac130002",
    "a10d0776-495a-11e8-9d32-0242ac130002",
    "a10d08ac-495a-11e8-9d32-0242ac130002",
    "a10d09d8-495a-11e8-9d32-0242ac130002",
    "a10d0b04-495a-11e8-9d32-0242ac130002",
    "a10d0c26-495a-11e8-9d32-0242ac130002",
    "a10d0d52-495a-11e8-9d32-0242ac130002",
    "a10d105e-495a-11e8-9d32-0242ac130002",
    "a10d125c-495a-11e8-9d32-0242ac130002",
    "a10d1392-495a-11e8-9d32-0242ac130002",
    "a10d14fa-495a-11e8-9d32-0242ac130002",
    "a10d16bc-495a-11e8-9d32-0242ac130002",
    "a10d18a6-495a-11e8-9d32-0242ac130002",
    "a10d1a72-495a-11e8-9d32-0242ac130002",
    "a10d1f0e-495a-11e8-9d32-0242ac130002",
    "a10d2134-495a-11e8-9d32-0242ac130002",
    "a10d22c4-495a-11e8-9d32-0242ac130002",
    "a10d23fa-495a-11e8-9d32-0242ac130002",
    "a10d2530-495a-11e8-9d32-0242ac130002",
    "a10d265c-495a-11e8-9d32-0242ac130002",
    "a10d2788-495a-11e8-9d32-0242ac130002",
    "a10d28b4-495a-11e8-9d32-0242ac130002",
    "a10d29e0-495a-11e8-9d32-0242ac130002",
    "a10d2b02-495a-11e8-9d32-0242ac130002",
    "a10d2c2e-495a-11e8-9d32-0242ac130002",
    "a10d2d5a-495a-11e8-9d32-0242ac130002",
    "a10d2e72-495a-11e8-9d32-0242ac130002",
    "a10d2fc6-495a-11e8-9d32-0242ac130002",
    "a10d30e8-495a-11e8-9d32-0242ac130002",
    "a10d320a-495a-11e8-9d32-0242ac130002",
    "a10d3340-495a-11e8-9d32-0242ac130002",
    "a10d349e-495a-11e8-9d32-0242ac130002"
   ]
  },
  "toc": {
   "base_numbering": 1,
   "nav_menu": {},
   "number_sections": true,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {},
   "toc_section_display": true,
   "toc_window_display": true
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}